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Abstract 

A longitudinal study of high school academic and vocational achievement 
for an elementary education parent involvement program is presented. Program 
students are compared j their older, non-program siblings on the Differential 
Aptitude Test and the Science Research Associates Achievement Series. After 
factor analyzing the Differential Aptitude Test, results showed a positive 
significant effect r or an academic factor. 

These results provide additional long-term achievement information for 
elementary compensatory programs and complement previous work with this 
sample on other school success variables* The achievement results' are rele- 
vant to the students' aspirations beyond high school* Studies of this type 
allow for evaluation of long-term cost effectiveness and gains for the deve- 
lopment of human potential* 



The Later Effects of the Parent Education Follow Through Program on Achievement 
Scores Ear Matched Pairs of Program Children and their Non-Program Siblings 

Since many compensatory education programs began during the late 1960*s t 
some of the students are now of hifch school age. Consequently t it is now possible 
to examine long-term effects related to the participation of these students in an 
educational Intervention during their early years of schooling. According to 
Goodrich and St. Pierre (Note 1), "The long-term effects of educational programs 
is an important but neglected area of study" (p. 1). One such compensatory 
education program which began in the late 1960*s is the Parent Education Follow 
Through Program. 

The Parent Education FolJow Through Program (PEFTP) is one of fifteen 
federally funded* national ?oliow Through models which implements its compen- 
satory elementary education program in various communities throughout the nation. 
Tht f ogram was designed for low-income children in grades K-3 and is based on 
**he belief that factors other than classroom instruction are important to quality 
education. The focus of the P2FTP model la upon parent involvement and parti* 
cipation in the education of their children. The major tenets of the program 
are that parents ara the first and most important teachers of their children and 
that the home, the school t the community shotiLd work in reciprocal ways to 
enhance the development of children. Three key features of the PEFTP are: 
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(1) a home visit component In which paraprofessional parent educators visit 
the homes of the children and deliver home learning activities which the parent 
does with the child, utilizing specific teaching behaviors; (2) a parent volun- 
teer element In which parents spend time In their child *s classroom, often engaged 
In Instructional activities; and (3) active parent Involvement In the governance 
and operation of the program. 

The PEFTP has been implemented in communities around the country during the 
past 16 years. Each of these communities has v^rked closely with the model 
aponsor located at the University of North Carolina at Chapel Hill. The setting 
for this study, which will be described in more detail later, is one of these 
communities. Three groups of students in this community who entered the PEFTP in 
either 1969*70, 1970*71, or 1971-72, were in graces nine through eleven during the 
1981-82 school year (the time of data collection), if normal grade progression 
is assumed. This sample will be discussed in > greater detail in a later section. 

Recently, the importance of invest igatint^tjbe long-term effects of programs 
for children and families has received increased attention (e.g., Gray, Ramsey, 
& Klaus, 1982; Schweinhart & Weikart, 1980; Cloud, Rentfrow, Hildebrandt, Abrams, 
£ DeCausey t Note 2). The findings to be presented in this paper are one cotrr 
ponent of a longitudinal study which is beitig undertaken by the PEFTP to collect 
and analyze several categories of data pertaining to student outcomes such as 
school success variables, achievement scores and aptitude test performance. 

The present study of school achievement and aptitude test scores is viewed 
as complementing earlier positive results for the same sample of subjects on 
drop-out rate, special education placement, and grade retention (Rubin, Olmsted, 
Szegda, Wetherby^ & Williams, Note 3). In this previous stu<3y t significant 
differences in favor of the PEFTP students were found for drop-out rate, and 
for PEFTP females for grade retention. Additionally, it was found that of those 
children placed in special education classrooma, non-PEFTP siblings spent 



more than twice as many years in these placements as did the PEETP -students. 

The purpose of this study is to examine eighth grade achievement and ninth 
grade aptitude scores for students who have participated in the Parent Education 
Follow Through Program. The major objective of this later effects study is to 
compare BEFTP graduates with their older, ncn-PEFTP siblings on several achievement 
and aptitude measures. 

Related Studies 

Two types of longitudinal (lata will be included in this review. The first 
will consist of studies which focused on compensatory education programs involving 
preschool children and the second type will consist of programs which served 
elementary school aged children. It should be noted that for the purposes of this 
discussion, a study will be considered to be longitudinal if the data were 
gathered a minimum of three years after the intervention ended. A second criterion 
for including & study in this review was that the subjects on whom the data were 
collected must have been; in any of the grades from sever* to twelve. 
Preschool Studies 

The largest and most ambitious study of the long-term effects of preschool 
compensatory education has been that of the Consortium for Longitudinal Studies 
(Note 4) . This collaboration of twelve experimentally designed and well-imple- 
mented preschool programs provided a wealth of data. 

One of the twelve preschool programs included in the Consortium was the 
Early Training Project (ETP) , developed by Susan Gray. Gray (1983) reports on 
a follow-up study that was begun seven years after the ETP's inception. Although 
no lasting effects were expected, it was found that there was a weak tendency 
for experimental females to score higher than other groups on intelligence tests. 
It was also found that the distribution of their grade point averages approached 
significance wf.th the experimental females maintaining a higher average than the 
local control females* Also a slightly higher percentage of the experimental 
females graduated from high school. 
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Schweinhart and Weikart (1980) report that preschool education contributed 
to increased school achievement for elementary and middle school children. At 
age 14, there were highly significant differences in favor of program children 
on the California Achievement Test in Arithmetic, Reading and Tanguage subtests* 

A study was conducted by Miller and Bizzell (1983) which examined the long- 
term effects of four preschool programs on 6th, 7th, and 8th grade students* 
The four programs were: Traditional* Bereiter~Englanann, DARCEE, and Montessori* 
Differential effects related to preschool program and ajp for all three middle 
school years were found for reading and math* Hales from the Traditional and 
the Montessori programs scored significantly higher on the Stanford Achievement 
Tests than males from the Bereiter-iSnglemann and DARCEE programs* Females from 
the Bereiter-Englemann and DARCEE programs were slightly higher than other groups 
hut not significantly so. Montessori males were consistently, found to be the 
highest group. 

TWo final studies following up Consortium projects need to be mentioned. 
Karnes, Sbwedel and Williams (1983) report no aignificant effects for high school 
achievement as measured by the Comprehensive Test of Basic Skills (CTBS)* - On 
the other hand. Palmer (1976) found aignificantly higher reading achievement at 
grade seven for those trained early versus their controls. 

An eight year follow-up stuJjr of the long-term effecta of ESEA Title I pre- 
school *n4 all day kindergarten students is reported by Nieman and Gastright 
(Note 5)* At the end of both 4th and 8th grades, the treatment group was 
significantly higher on both the reading and total math subtests of the Metro- 
politan Achievement Test. 

When summarizing the findings of several reae&rchers who examined later 
effects of preschool intervention. Palmer and Anderson(1979) generally conclude 
that early intervention influences reading performance and shows strong evidence 
for effects on arithmetic achievement* 
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Elementary Studies 

Data on school-aged compensatory education programs will follow. Cloud et al, 
(Note 2), using a conceptual model similar to that of the Consortium* examined the 
later effects of the Tuscon Early Education Model Follow Through Program. In their 
report concerning the high school success of Follow Through graduates and their 
siblings, Cloud et al. (Note 2) report on achievement as reflected by school grades 
rather than achievement test scores. Their findings were that although the differ- 
■ ences in school grades for the Follow Through and non-Follow Through groups did not 
reach statistical significance, the Follow Through group had higher school grades in 
both math and science. 

Gersten and Camine (Note 6) report effects on achievement for 9th g?ade gradu- 
ates of the Direct Instruction Follow Through model. Significant positive results 
on achievement were found in the urban, but not the rural Follow Through sites. 
Also, Weber and Fuhrmann (Note 7) report results that showed significant later 
effects in reading and math on the California Achievement Test for 9th graders 
who had completed the Direct Instruction program. 

Maraschiello (1979) describes the results of a longitudinal analysis of 
school performance for children enrolled in the Follow Through programs in Phila- 
delphia. Children from seven models were compared on achievement scores in total 
reading and total mathematics as measured by the California Achievement Test. 
The Educational Development Center Model was the only model which had consistent 
long-term effects on children f s post-program (grade four to grade nine) achievement 
in reading and mathematics* Studied as a single unit, the total Follow Through 
program had a positive effect on mathematics achievement for both program and 
post~program years. 

Seitz, Apfel, and Efron (1978) discuss lster effects of the Bank Street 
Follow Through model. They report a pattern of Follow Through boys scoring 
higher than non Follow Through boys on mathematics t general information, and the 
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Peabody Picture Vocabulary Test* These results occurred at the completion of the 

program and remained similar through 6th and 8th grade retesting. Seitz et al* 

(1978) report the finding of a sleeper effect for Follow Through girls in spelling 

and total Peabody Individual Aptitude Test scores* The Follow Through girls 

scored significantly higher than the non-Follow Through girls in these areas* 

* In another article related to this same,study, Seitz, Apfel, Rosenbatim, and Zigler 

(1983) report on the meaning of their findings in terms of Head Start and Follow 

Through* They state: 

Our results indicate that an extensive period of school-based inter- 
vention during the child's first few years of school can have 
measurable lasting benefits for at least some groups of children* * * 
In terms of long-range effects, a consistent finding* * * was that 
the FT [Follow Through] group whose scores were superior to those 
of their NFT controls revealed their superiority in the atfeas of 
mathematics, general information, and PFVT [Peabody Picture Vocabu- 
lary Test] IQ* * * * Our results indicate no fade-out of Follow 
Through program effects on general information 6 to 7 years following 
termination of the program* (pp* 325-326) 

L 

Longitudinal^data have been reviewed from both preschool and elementary 
compensatory education programs* These data have been related to the later 
effects of these programs upon students who have reached grade seven and beyond* 
The variables of interest for these later effects were limited to achievement 
and aptitude measures* 

Overall it can be concluded that there is a clear pattern of program- 
favoring effects for achievement* Although statistically significant levels are 
not reached for all measures for all programs, the finding that some program 
advantages were found three or more years after program participation *iad ended 
is impressive* 

In this pap?r we will contribute additional data to this bank of literature* 
These data will pertain to achievement and aptitude scores for 8th and 9th grade 
students who were early participants of the Parent Education Follow Through 
Program. 



ERIC 



a 



7 



Method . 

This, study was conducted In the city of Richmond, Virginia which Is 
located In the center of a metropolitan area. The population of the entire 
metropolitan area Is approximately 546,000, while the city of Richmond has 
a population of approximately 227,000 (Ellis, 1980). 

the PEFTP was adopted by the Richmond Public School System in 1968. This 
system is basically an inner city school system with a predominantly black 
student population. Through the years the PEFTP has been Implemented In 40 
classrooms in 10 elementary schools around the city of Richmond. The level 
of program implementation has been consistently high as indicated by both local 
evaluation reports and model sponsor evaluation reports (Halstead, Note 8; 
Olmsted & Rubin, Note 9). 
Sample 

The sample of program children for this atudy has been drawn from those 
children who entered the program as kindergarten students during 1969*70, 
1970-71 or 1971-72, or joined one of these cohorts before third grade. Using 
a 1980-81 directory of students in the community's school system, a listing was 
made of all program students in the system at that time. Utilizing the current 
student directory of the community to locate student files, the final list of 
subjects was compiled consiating of children who: (1) had participated in the 
PEFTP program for a minimum of two years; (2) had a sibling between 1 and 5 years 
older; and (3) had a complete cumulative school record as of the end of the 
1980-81 school year. The Initial number of subjects in the three cohorts was 
approximately 450 and the number who met the three criteria just lifted was 122. 

The sample of comparison children is composed of older siblings of students 
in the program sample. For each program child, the older sibling closest In age 

er|c ■ i 0 



who had not participated in the program and who had a complete cumulative record 
was selected for the comparison sample. The use of an older-sibling comparison 
group design has been reported by other researchers (e.g., Jensen, 1974; Cloud 
et al., Note 2). One advantage of an older-sibling comparison group design is 
the common backgrounds of the subjects in the two groups, including home, 
neighborhood or community, and school. Although evidence has been found of 
program effects diffusing dovn^to younger children in the family, there has been 
no evidence of upward diffusion; so it is reasonably safe to conclude that there 
are few, if any, contaminating program effects for the comparison group (Gray, 
1971; Moreno, 1974; Ware, Organ, Olmsted & Moreno, 1974). 

The set of subjects for the current analysis consisted of 51 program children 
and their older siblings. Pairs for which either the PEFTP or older sibling 
student received special education or where complete achievement and aptitude 
files were not available were eliminate^ from the original sample. The ethnicity 
distribution for the bl families was black * 98% and white * 2%. For both the 
Follow Through and the sibling groups, 53% were female and 47% were male. The 
levels of education for the father and mother for ths families in the study were 
as follows: 

Level of Education % Fathers % Mothers 

8th Grade or less 3.9 5.9 

9th-12th Grade 51.0 64.7 

Beyond high school 3.9 11.8 \ 

No information 41.2 17,6 v 

As of the e^l of the 1980-81 school year, 65% (n « 33) of the program children 

and 45% (n * 23) of the older sibling group were still enrolled in the Richmond 

Public School System. The distribution of the students in these two groups 

across grade levels was as follows: 
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Grade* X PEFTP group X Older Siblings 

8 6,1 

9 39.4 13.0 

10 18.2 21.7 

11 15.2 v 17.4 

12 21.2 47.8 



♦Includes students in the grade level for initial time as well as 
those repeating a grade level. 

Procedure 

The initial step consisted of obtaining written consent from' the school 
system for conducting the study, as well as consent from the Richmond PEFT program 
director and the chairperson of the policy advisory committees Following* this, . 
the instrument on which student cumulative file information was. to be coded was 
developed by the PEFTP model sponsor staff at the University of North Carolina in 
Chapel Hill (tJNC-CH) s 

Data relevant to this study that were coded included the Stanford Research 
Associates (SRA) Achievement Series, taken in the eighth grade, first semester, 
and ninth grade Differential Aptitude Test (DAT) .scores* Both of these tests 
were used because they are designed for somewhat different purposes* The SRA 
reflects academic achievement, whereas the DAT measures academic and vocational 
aptitude* The eighth grade first semester SRA scores were the grade/semester 
scores available for the majority of the sample, and the ninth grade DAT scopes 
were the only ones available* 

Five persons residing in the community were employed as coders* Their 
training consisted of 2 1/2 days of Instruction and practice coding and was 

conducted on-site by a PEFTP sponsor staff member from UNC-CH* Once the training 

— *- ■ 

was completed, each person coded ten randomly selected student cumulative records 
for use In obtaining \he first estimate of reliability (Time 1)* This esti- 
mate was obtained by comparing the records of the coders with records coded 
by the trainer, who served as the standard criterion* A second estimate of 
reliability was obtained using the same procedure at the completion of the -data 

.12 
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coding (Time 2) « 



Reliabilities (as compared to 



the criterion) for items relevant to the 



present study vere as follows: 



Item 



Time 1 



Time 2 



ethnicity 
sex 

birthdate 

SRA 

DAT 

parents' educational level 
grade in 1980-81 * - 



\ 



100%, 
100% 
96% 
94% 
98% 
89% 
86% 



100% 
100% 
100% 
88% 
100% 
84% 
90% 



Wherever the items consist of more than one variable (e.g. various SRA 
subtests), the reliability given above is the average reliability for the item. 

One final reliability check vas made between the person vho coded the data 
for computer processing and the person serving as the standard criterion through- 
out .the study. Each person computer^coded- ten completed coding-forms received 
from Richmond. An estimate of inter-coder agreement vas then calculated. All 
reliabilities for items relevant to the study ranged between 90% and 100* vith 
nearly all reliabilities being 100%. 
Hypotheses 

The data to be reported ii> this paper include only a small number of the 
total set of outcome variables. The hypotheses to be tested in this study are 
as follows: 

1. There is no sigrificant relationship between participation in the 
PEFTP and scores on the Science Research Associates (SRA) Achievement Series. 

2. There is no significant relationship between participation in the 
PEFTP and scores on the Differential Aptitude Test (DAT) . 

Statistical Procedures 

A Principal Components analysis was performed in order to reduce the eight 
DAT subtests to a smaller number of factors. Subsequently, Multivariate Analyses 



of Variance (MANOVAs) were performed separately for the SRA and DAT. A randomized 
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block design was employed to reduce error variance* The Introduction of a 
variance coin; :>nent for family provides a more powerful test of group differences* 
The MANOVA for the SRA Included the Reading Total, Mathematics Total, and Language 
Arts Total as dependent variables, while the MANOVA for the DAT Included the j 

i 

factor variables as dependent 'variables. 

\ 
i 

Results 

Descriptive and Inferential statistics are' presented In this section for 
both the SRA Achievement Tests (SRA) and the Differential Aptitude Test (DAT) 
analyses. For each of these analyses, statistical assumptions relating to 
normality and homogeneity of the varlance-covar lance matrices were Investigated. 
The results of these tests are not reported except for cases where these assumptions 
were net met. 
SRA 

The test of homogeneity of the varlance-covar lance matrix for the SRA was 
significant, Indicating heterogeneity. Therefore, a conservative F test would 
have to be met to indicate statistical sigiiif icance (Geisser & Greenhouse, 1958)* 

Means and standard deviations for the three SRA subtests for the FEFTF and 
older sibling groups are reported in Table 1. It can be noted that in each case 
the PEFTP means are higher. 

The omnibus conventional MANOVA was not significant, indicating that the con- 
servative F test would surely have been none ign if leant if applied (Kirk, 1968). 
The results of the conventional test are provided in Table 2 (Wilk's Criterion 9 
.9105, F (3> 48) - 1.57, p> .05). 
DAT 

Principal Components analyses on the eight DAT subtests were first performed 
separately on the two groups. Subsequent to the finding that the pattern 
structure of the subtests for the two groups was not significantly different, the 
groups were ombinzd and a single factor pattern derived. The first two factors 
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Table 1 

Means and Standard Deviations on the SUA For PEFTP and Older 

Sibling Groups 



PEFTP Group 

Subtest n Mean Standard 

Deviation 



Beading Total 51 313.69 50.30 

Language Arts Total 51 324.27 48.91 
Mathematics Total 51 333.22 61.95 













Older Sibling Group 






Subtest 


n Mean 


Standard 








Deviation 





Reading Total 51 
Language Arts Total 51 
Mathematics Total 51 



301.57 63.85 
314.22 47.96 
312.73 48.27 



0 

ERIC 



15 



Table 2 

MAKOVA Results for the SRA Analysis 



Test £ df £ 

Omnibus Multivariate Test 1.57 3, 48 p> .05 

Reading Total N/it* 

Language Arts Total N/A* 

Mathematics Total N/A* 



*Follow-up tests not appropriate. 
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were retained, and together they accounted for approximately 61% of the variance. 

The resulting factor pattern, provided In Table 3, yields two factors which 
roughly correspond to an "Academic" and a "Vocational" Factor. The Academic 
Factor (Factor 1) has high loadings for the Verbal Reasoning, Numerical Ability, 
Abstract Reasoning and Language Usage subtest* of the DAT, with moderate loadings 
for the Mechanical Reasoning and Space Relations subtests. In contrast, the * 
Vocational Factor (Factor 2) has a high loading for the Spelling subtest, with 
moderate loadings for the Clerical Speed and Accuracy subtest, and a moderate 
negative loading for the Mechanical Reasoning, and Space delations subtests. 

Means and standard deviations for the two factors are presented in Table 4/ 
It can be noted that in both cases the FEFTP means are higher. 

The omnibus MANOVA, presented In Table 5, was significant (Vilk's Criterion » 
.8262, F(2, 49) " 5.15, p <.05). Univariate follow-ups show a significant FEFTP* * 
favoring difference On Factor^l (F(i^ 50) ■ 10.48, p < .025). The difference 
for Factor 2, while PEFTP-favoring, was non-significant (F(x, 50) ■ 1.28, p > .025>. 
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Table 3 
DAT Factor Pattern 
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DAT Subtests 



Factor 1 



Factor 2 



Verbal Ability 
Ifcmerical Ability 
Abstract Reasoning 
Clerical Speed & Accuracy 
Mechanical Reasoning 
Spatial Ability 
Spelling 
Language 



0.735 
0.803 
0.742 
0.186 
0.561 
0.540 
0.447 
0.742 



-0.073 
0.183 

-0.255 
0.571 

-0.515 

-0.592 
0.760 
0.348 



Table 4 

Means and Standard Deviations on the DAT Factor Scores 
For PEFTP and Older Sibling Groups 



PEFTP Group 



Factor _n 

1 (Academic) 51 

2 (Vocational) 51 



Mean 
38.42 
24.36 



Standard 
Deviation 

8.26 

14.0ft 



Older Sibling Group 



Factor 

1 (Academic) 

2 (Vocational) 



jn 

51 

51' 



Mean 
34.62 
21.83 



Standard 
Deviation 

7.77 

12.69 



* 
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Table 5 

HAHOVA Results for the HAT Analysis 



Test F 

Otaibus Multivariate Test 5.15 

Factor 1 10.48 

Factor 2 1.28 



df 
2, 49 
1, 50 
1, 50 



pi. 05 

P<.025 

p>.025 
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Dlacu talon 

The results just presented indicate that there was a significant difference 
favoring the PEFTF group for overall OAT performance* Univariate follow-up 
analyses performed on the two OAT factors resulted in a aignificane PEFTP*favoring 
difference on the Academic .factor and no significant difference between the two 
groups on the Vocational factor* Fdr both DAT factora, the PEFTP group mean 
scores were higher than those for the older albling grou^r\Although no aignificant 
difference was found between the two groups on SKA performance, it is important to 
note that for all three subtests the PEFTP group mean scores were higher than those 

4 

for the older sibling group* > « , 

The reader is reminded that the results should be interpreted with caution* « 
The findings can only be generalized to a similar black urban population* In 
addition* it should be noted that the national Follow Through program was not 
originally deigned as an educational expetiment and therefore, no random assign- 
ment was employed* However, In this study, PEFTP students were compared with 
their siblings, so that many Important socioeconomic and home background factors 
were adequately controlled* Additionally, many characteristics of the sample 
were representative of thoae of the general school population of Richmond* 

An important fsctor pertaining to this study relstes to the esrly stsge of 
development" of the PEFTP at the time when these families were psrticipsnts* During 
these early years/ program development was a major activity involving the pilot 
testingN^f both materials and methods for effective program implementation* 
The PEFTP program became more well-defied during the next few yeara* 

When the iasuea presented above are taken into consideration, the finding 
that the PEFTP ' group meuts are higher than thoae of the older sibling group for 
all five comparisons may M\stronger evidence of program effectiveness than 
might appear at first glance* Although significance is not reached for every 
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comparison, this pattern of Follow Through- favoring results is consistent with 
the results reported by other researchers. 

In their study of long-term effects of preschool programs, Miller and Bizzell 
(1983) suggest that the early educational experiences which children have may 
continue to affect learning processes for many years* Seitz et al> (1978) speak 
of early school experience laying a general groundwork for later educational 
performance. Even though the PEFTP was still in its developmental stage, certain 
basic program elements were being implemented, albeit in unpolished form. These 
elements, including parent-child instructional interactions, home-school relation- 
ships, parental expectations for the child, etc., may have provided an educational 
base, the effect of which extended beyond the program participation years. The 
present results^, coupled with the positive results for the same sample of students 
for school drop-out, grade retention and special education variables provide 
additional support for this supposition. 

At this time t five Follow Through programs have reported aignif leant later- 
effects of participation, noted at least three years after program participation 
had ended. When the preschool program longitudinal data, collected after a 
similar post-program interval, are added to theJPollow Through longitudinal data, 
the evidence of the impact of compensatory education programs continues to grow. 
The effects of these special programs are not only Immediate, but continue to 
last into middle-school and high-school years. The collection of longitudinal 
data needs to be continued in order to provide a larger information base for 
answering important questUona about compensatory education. For example, "Do 
certain categories of children benefit more than others by participating in a 
particular compenaatory education program? 1 * and "What relationships exist between 
particular longitudinal effects and particular compensatory education programs?" 
The answers to these and other related questions will provide information to help 
guide the future direction of compensatory education. 
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